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PIPELINE ACCEtERATOR HAVING MULTIPLE PIPELINE UNITS AND RELATED 

COyPUTING IVIACHINE AND METHOD 

Claijm of prjority 

f1] This applicati<Mi claims priority to U.S. Provisfonal Application Serial 

No. 60/422,503, filed on October 31 , 2002, which Is incorporated by reference. 

Cross reference to related applications 

£2} This application is related to U.S. Patent App. Serial Nos. 10/684,102 

entitled li\4PROVED COMPUTING ARCHITECTURE AND RELATED SYSTEM AND 
METHOD, 10.684,053 entitled COMPUTING MACHINE HAVING IMPROVED 
COMPUTING ARCHITECTURE AND RELATED SYSTEM AND METHOD, 
10/683,929 entitled PIPELINE ACCELERATOR FOR IMPROVED COMPUTING 
ARCHITECTURE AND RELATED SYSTEM AND METHOD, and 10/684,057 entitled 
PROGRAMMABLE CIRCUIT AND RELATED COMPUTiNG MACHINE AND 
METHOD, ail filed on October 9, 2003, and having a common owner, and which are 
incorporated by reference. 

BACKGROUND 

C33 A common computing architecture for processing reiativeiy large 

amounts of data in a mlatively short pedod of time includes multipfe Interconnected 
prx)cessors fliat share the processing burden. By sharing the processing burden, 
these multiple processors can often process the data more qutckiy than a single 
processor can for a given clock frequency. For example, each of the processors can 
process a respective portion of the data or execute a respective portion of a 
processing algorithm. 

[4] FIO. 1 is a schematic block diagram of a conventional computing 

machine 10 having a multJ-processor archited:ure. The machine 10 includes a 
master processor 12 and coprocessors f 4* - 14a, which communicate with each 
other and ttie master processor via a bus 16, an Input port 18 for receiving raw data 
from a remote device (not shown in FIG. 1), and an output port 20 for providing 
processed data toUie remote source. The machine 10 also Includes a memory 22 
for the master processor 12, respective memories 24i - 24n for the coprtJcessors 14i 
~ 14„, and a memory 26 that the master prxKsessor and coprocessors share via the 

1 
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bus 16. The memory 22 serves as both a program and a working memory for the 
master processor 12, and each memory 24i — 24^ serves as both a program and a 
working memory for a respective coprocessor f 4f - 14^. The shared memory 26 
allows the master processor 12 and the coprocessors f 4 to transfer data among 
themsetves. and from/to the remote device via the ports IB and 20, respedively. 
The master processor 12 and the coprocessors 14 also receive a common dock 
signal that controls the speed at which the machine 10 processes the rav^ data. 

153 In genera!, the computing machine iO effectively divides the 

processing of raw data among the master processor 12 and the coprocessors i4. 
The remote source (not shown in FiG* 1) such as a sonar airay loads the raw data 
via the port IS into a section of the shared memory 26, which acts as a 
first-in-first«out (FIFO) buffer (not shown) for the raw data. The master processor 12 
retrieves the raw data from the memory 26 via the bus 16, and then the master 
processor and the coprocessors 14 process the raw data, transferring data among 
themselves as necessary via the bus 16. The master processor 12 loads the 
processed data into another FfFO buffer (not shown) defined in the shared memory 
26, and the remote source retrieves the processed data from this FIFO via the port 
20. 

[6] f n an example of operation, the computing machine 10 processes the 

raw data by sequentially performing n 1 respective operations on the raw data, 
where these operations together compose a processing algorithm such as a Fast 
Fourier Transform (FFT). More spedfScaHy, the machine 10 forms a data-processing 
pipeline from the master processor 12 and the coprocessors 14, For a given 
frequency of the clock signal, such a pipeline often allows the machine fO to process 
the raw data faster than a machine having only a singie processor. 

[7J After retrieving the raw data from the raw-data FIFO (not shown) in the 

memory 26, the master processor 12 performs a first operation, such as a 
trigonometric function, on the raw data. This operation yields a first result, which the 
processor 12 stores in a first-resuit FIFO (not shown) defined within the memory 26. 
Typically, the processor 12 executes a program stofBd in the memory 22, and 
performs the above-described aotions under the control of the program. The 
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processor 12 may a!so use the memory 22 as working memory to temporarily store 
data that the processor generates at intermediate intervals of the first operation. 

{S3 Next, after retrieving the first result from the first-resuft FIFO (not 

shown) in the memory 26, the coprocessor 14i perfonDS a second operation, such 
5 as a logarfthmic function, on the first result. This second operation yields a second 
result which the coprocessor 14i stores In a second-result FIFO (not shown) defined 
Within the memoiy 26. TyplcaHy, the coprocessor 14i executes a program stored in 
flie memory 24i, and performs the above-described actions under the control of the 
program. The coprocessor 14i may also use the memory 24^ as working memory to 
10 temporarily store data that the coprocessor generates at intemnedfate intervals of the 
second operation. 

|93 Then, the coprocessors 242 - 24o sequenliaily perform third - 

operattons on the second - {n-if results in a manner similar to that disojssed 
above for the coprocessor 24i. 

15 |1 0] The n^ operation, which is performed by the coprocessor 24,,, yields 

the flnai result, Ae., the processed data. The coprocessor 24„ loads the processed 
data into a processed-data FIFO (not shown) defined within the memoty 26, and the 
remote device (not shown In FIG, 1 ) retrieves the processed data from this FIFO, 

|1 1] Because the master processor 12 and coprocessors 14 are 

20 simultaneously performing different operations of the processing afgorithm, the 

computing machine 10 is often able to process the raw data faster than a computing 
machine having a single processor that sequentiaily performs the different 
operations. SpecificaHy, the single processor cannot retrieve a new set of the raw 
data unti if peifomns ail n + 1 operations on the previous set of raw data. But using 
25 the pipeline technique discussed above, the master processor 12 can retrieve a new 
set of raw data after performing only the first operation. Consequently, for a given 
dock frequency, this pipeline technique can Increase the speed at which the 
machine 10 processes the raw data by a factor of approximateiy n 1 as compared 
to a single-processor machine (not shown in FIG. 1), 

30 [12] Altarnativaly, the computing machine 10 may process the raw data in 

paraiiel by simultaneousty performing n + 1 instances of a processing eigonthm. 
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such as an FFT, on the raw data . That is, if the algorithm inctudes n ^ 1 saquantia! 
operations as described above in the prBvious example, then each of the master 
processor 12 and the coproGessors 14 sequential ty perform ail n 4- i operations on 
respective sets of the raw data. Consequently, for a given clock frequency, this 
5 paratiel-processjng technique, like the above-d escribed pipetine technique, can 
increase the speed at which the machine 10 processes the raw data by a factor of 
approximatefy n 1 as compared to a single-proGessor machine (not shown §n FIG. 

113] Unfortunately, although the computing machine 10 can process data 

10 more quickly than a single-processor computing machine (not shown in Fl<3. 1 ), the 
data-processing speed of the machine 10 is often significantly less than the 
frequency of the processor dock, Spedfica!fy, the data-processing speed of the 
computing machine 10 is iimited by the time that the master processor 12 and 
coprocessors 14 require to process data. For brevity, an example of this speed 

15 iimitation is discussed In conjunction with the master processor 12, although it is 
understood that this discussion also applies to the coprooessors 14. As discussed 
above, the master processor 12 executes a program that controls the processor to 
manlpolate data in a desired manner Tliis pnogram inciudes a sequence of 
instructions that the processor 12 executes. Unfortunateiy, the processor 12 

20 typicaHy requires muStiple clock cycies to execute a single instruction, and often must 
execute multipie Instnjctions to process a single value of date. For example, 
suppose that the processor 12 is to multiply a first data value A {not shown) by a 
second data value B (not shown). During a first dock cycle, the pracessor 12 
retrieves a muitipiy instructfon from the memory 22, During second and third clock 

25 cycles, the processor 12 respectively retrieves A and B from the memory 26. During 
a fourth dock cyda, the processor 12 multiplies A and B, and, during a fifth dock 
cycle, stores the resulting product in the memory 22 or 26 or provides the resulting 
product to the remote device (not shown). This is a best-case scenario, because in 
many cases the processor f 2 requires additiona! clock cycies for overhead tasks 

30 such as initializing and dosing counters. Therefore, at best the processor 12 
requires five clock cycies, or an average of 2.5 clock cycles per data vaiue, to 
process A and B.. 
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|14] Consequentiy, the speed at which the computing machine 10 

processes data h often significantly lower than the frequency of the clock that drives 
the master processor 12 and the coprocessors 14. For example, if the processor 12 
IS ofocked at 1 .0 Gigahertz (GHz) but requires an average of 2.5 ciook oycies per 
5 data value, then the effective data«processlng speed equals (1 .0 GHz)/2.5 - OA 
GHz. This affective data-processing speed is often characterized in units of 
operations per second. Therefore, In this example, for a clock speed of 1 ,0 GHz, the 
processor 12 wouid be rated with a data-processing speed of 0,4 
Gigaoperations/second (Gops), 

10 [15] FIG* 2 is a block diagram of a hardwired data pipeline 30 that can 

typicalty process data faster than a processor can for a given dock frequeocy, and 
often at substantiatiy the same rate at which the pipeline is cloaked. The pipeline 30 
mdudes operator circuits 32i - 32„,¥/hich eadi perform a respective operation on 
respective data without executing program instnjctions. That is, the desired 

15 operation Is "burned in'' to a circuit 32 such that it impiements the operation 

automaticalSy, without the need of program instructions. By eliminating the overhead 
associated with executing program instructions, the pipeiine 30 can typical!y perform 
more operations per second than a processor can for a given dock frequency. 

tISJ For example, the pipeline 30 can often solve the foilowing aquation 

20 faster than a processor can for a given dock frequency: 

Y{xk) = (5xi, ^ 3)2^ 

where represents a sequence of raw data values. In this example, the operator 
circuit 32f Is a multiplier that calculates 5Xk, the circuit 32^ is an adder that calculates 
5xk^ 3, and the circuit 32„ (n = 3) is a multtplier that calculates (5Xk * 3)2"^, 

25 [17] During a first cSock cycle k^^l , the circuit 32i receives data value xi and 

multipiiea it by 6 to generate 5xi. 

[183 During a second dock cycle k - 2, the circuit 322 receives 5xi from the 

circuit 32i and adds 3 to generate 5xi ^ 3. Also, during the second dock cycle, the 
circuit 32i generates 5x2* 

30 ^^^^ During a third dock cycle k - 3, the circuit 323 receives 5xi + 3 from the 

circuit 322 and multfpiies by 2'''^ (effectively left shifts 5xi + 3 by Xi) to generate the 
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first result (5xi ^ 3)2^ \ Also during the third clock oycla, the circuit 32i generates 6x3 
and the circuit 322 generates 5x2 ^ 3, 

£20] The pipeline 50 oorttinues processing subsequent raw data vaiues In 

this manner until all the raw data valyes are processed, 

[211 Consequentiy, a delay of two clock cycies after receiving a raw data 

value Xi — this delay is often called the latency of the pipeline 30 — the pipeline 
generates the result (5xi ^ 3)2'*\ and thereafter generatea one result ^ — e.g., (6x2 
3)2'^^, (5X3 ^ 3)2^^ . , 6xn + 3)2"'^' each clock cycie. 

|22] Disregarding the latency, the pipeline 30 thus has a data-processing 

speed equal to the dock speed, fn comparison, assuming that the master pracessor 
12 and coprocessors 14 (FIG. 1) have data-processing speeds that are 0,4 times the 
clock speed as in the above example, the pipeline 30 can process data 2,5 times 
faster than the computing machine 10 (FIG. 1) for a given clock speed, 

|231 Still referring to FIG* 2, a designer may choose to implement the 

pipeline 30 In a programmabte logic !C (PLIC), such as a field-programmabte gate 
array (FPGA), because a PLIC allows more design and modification flexibility than 
does an application specific IC (ASIC), To configure the hardwired connections 
within a PLIC, the designer merely sets interconnection-configuration registers 
disposed within the PLIC to predetermined binary states. The combination of all 
these binary states is often callad 'Urmware/' Typically, the designer foads this 
firmware into a rionvolatiJe memory (not shown in FIG* 2) that is coupled to the PLIC. 
When one 'turns on'* the PLIC, it downloads the firmware from the memory Into the 
interconnection-configuraaon registers. Therefore, to modify the ftjnctioning of the 
PLIC, the designer merely modifies the firmware and allows the PLIC to download 
the modified firmware into the interconnection-configuration registers. This ability to 
modify the PLiC by merely modifying the firmware is particularly useful during the 
prototyping stage and for upgrading the pipeime 30 "in the field'*, 

P43 Unfortunately, the hardwired pipeline 30 may not be the best choice to 

execute algorithms that entail significant decision making, particularly nested 
deciston making. A processor can typically execute a nested-decision-making 
instruction {e.g., a nested conditional instruction such as "if A, then do B, else If C, 
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do D, . else do n^') approximateiy as fast as it can execute an oparattonal 
instruetlon {e.g., ""A + B") of comparable length. But aithough the pipeline 30 may be 
able to make a reiativeSy simple decision (e.g., ''A > efficiently, tt typically cannot 
execute a nested decision {e.g., If A. then do B, else ff C, do D, _ etse do n") as 
5 efficiently as a processor can . One reason for this {nefflciency is that the pipaiine 30 
may have iittia on«boarcl memory, and thus may need to access extarnaf 
working/program memory (not shown). And although one may be able to design the 
pipeline 30 to execute such a nested decision, the size and compSextty of the 
required circuitry often makes such a design impracticat, particuiariy where an 
1 0 afgorfthm tncfudes muitiple different nested decisions. 

[25| Oonsequentfy, processors are typically used in appfications that require 

significant decision making, and harelwired pipelines are typically limited to "number 
crunching'' applrcations that entail iittfe or no dedsbn making. 

|263 Furthermore, as discussed below, it ts typically much easier for one to 

15 desSgn/modify a processor-based computing machine, such as the computing 
machine 10 of FIG- 1 , than it is to design/modify a hardwired pipeline such as the 
pipeline 30 of FIG, 2, particuiariy where the pipeline 30 includes multiple PLiCs> 

[27] Computing components, such as processors and their peripheral 

(e.g., memory), typicaily indude industry^standard communication interfaces that 
20 facilitate the interconnection of the components to form a processor^based 
computing machine. 

[28] Typically, a standard communication interface includes two layers: a 

physicai iayer and a services layer, 

{293 T"he physical layer includes the circuitry and the corresponding circuit 

25 interconnections that form the interface and the operating parameters of this 
circuitry. For example, the physical layer includes the pins that connect the 
component to a bus, the buffers that latch data received from the pins, and the 
drivers that drive signais onto the pfns. The operating parameters inciude the 
acceptable voltage range of the data signals that the pins receive, the signal timing 
30 for writing and reading data, and the supported modes of operation {e.g., burst 
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mode, page mode), Conventionai physloai layers include transistor^transistor logic 
(TTL) and RAyBUS. 

|303 The services layer includes the protocol by which a computing 

component transfers data. The protocol defines the format of the data and the 
manner In which the component sends and receives the formatted data, 
Conventional communication protocols indude flie-transfer protocol (FTP) and 
transmission control protocoi/internet protocol (TCP/IP). 

[31] Consequentiy, because manufacturers and others typically design 

computing components having industry-standard commynication interfaces, one can 
typteally design the interface of such a component and Interconnect it to other 
computing components with relatively little eifort. This allows one to devote most of 
his time to designing the other portions of the computing machine, and to easily 
modify the machine by adding or removing components, 

[323 Designing a computing component that supports an industry-standard 

communication interfece allows one to save design time by using an existing 
physicaHayer design from a design library. This aiso insures that he/she can easily 
interface the component to off-the-shelf computing components. 

133] And designing a computing machine using Gomputing components that 

support a common industry-standard communication interface allows the designer to 
jnterconnect the components with little time and effort. Because the components 
support a cornnion interface, the designer can Interconnect them via a system bus 
with little design effort. And because the supported interface is an industry standard, 
one can easily modify the machine. For example, one can add different components 
and peripherals to the machine as the system design evolves, or can easily 
add/design next-generafion components as the technoiogy evolves. Furthermore, 
because the components support a common industry-standard services layer, one 
can incorporate into the computing machlne^s software an existing software modute 
that implements the corresponding protocol Therefore, one can Interface the 
components with little effort because the interface design is essentially already in 
ptace, and thus can focus on designing the portions (e.g., software) of the machine 
that cause the machine to perform the desired function{s}. 
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[34] But unfortunately, there are no known industr>^-stand a rd services layers 

for components, such as PLICs, used to form hardwired pipefines such as the 
pipeline 30 of FIG. 2* 

[3SJ Consequentfy, to design a pipeilne having multiple PLICs. one typically 

5 spends a significant amount of time and exerts a significant effort designing "from 
scratch" arKj debugging the services layer of the communication interface between 
the PLfCs. Typically, such an ad hoc services layer depends on the parameters of 
the data being transferred between the PLICs. Ukewise, to design a pipeline that 
interfaces to a processor, one would have to spend a significant amount of time and 
10 exert a significant effort in designing and debugging the sef\/tees iayer of the 
communication interface between the pipeline and the processor. 

136] Simifariy, to modify such a pipaiine by adding a PLIC to it one typicaliy 

spends a significant amount of time and exerts a significant effort designing and 
debugging the services layer of the communication interface between the added 
15 PLiC and the existing PLtCs. Likewise, to modify a pipelina by adding a processor, 
or to modify' a computing machine by adding a pipeline, one would have to spend a 
signlflcant amount of time and exert a sfgniffcant effort in designing and debugging 
the sen/ices layer of the communication interface between the pipefine and 
processor 

20 |37] Consequently, referring to FIGS* 1 and 2, because of the diffioutties in 

interfacing multiple PLICs and in interfacing a processor to a pipeline, one is often 
forced to make significant tradeoffs when designing a computing machine. For 
example, with a processor-based compyting machine, one is forced to trade number- 
crunching speed and design Anodification flexibiiity for complex deGJsion-making 

25 ability- ConverseSy, with a hardwired pipe!ine«based computing machine, one is 

forced to trade compiex-decision-making ability and design/modlficatjon flexibility for 
number-crunching speed. Furthermore, because of the difficulties in interfacing 
multipie PLICs, it is often impractical for one to design a pipeline-based machine 
having more than a few PLfCs. As a result, a practical pipeline-based machine often 

30 has limited functionality. And because of the drfficufties in interfacing a processor to 
a PLIC, it wouid be impractical to interface a processor to more than one PLIC. As a 
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result, the benefits obtained by combining a processor and a pjpef ine would be 
mnmal. 

[38| Therefore, a need has arisen for a new computing architecture that 

aliows one to combine the deotsion-making ability of a processor-based machine 
with the number-crunching speed of a hardwired-pipeline-based machine. 

Summary 

[39] According to an embodiment of the invention, a pipeline acceferator 

includes a bus and a pturality of pipeline units each coupled to the bus and each 
including at least one respective hardwired-pipeUne circuit. 

I40J By including a plurality of pipeline units in the pipeline accelerator, one 

can Increase the acceierator's data-processing performance as compared to a 
singfe-pjpellne-unit accelerator Furthermore, by designing the pipeline units so that 
they communicate with each other and with other peers via a common bus, one can 
alter the number of pipeline units, and thus alter the configuration and lunctionality of 
the accelerator, by merely coupHng or uncoupling pipeline units to or from the bus. 
This eliminates the need to design or redesign the pipalme-unit interfaces each time 
one altars one of the pipeline units or alters the number of pipeline units within the 
acceierator. 

BRiEF Description of the Drawings 

[411 FIG. 1 is a block diagram of a computing machine having a 

conventional muiti-processor architecture, 

|42] Fi<3. 2 is a block diagram of a conventional hardwired pipeiine, 

f431 FIG. 3 is a block diagram of a computing machine having a peer^vector 

architecture according to an embodiment of the Invention. 

|44| FtG. 4 is a block diagram of a pipeline unit of the pipeline accelerator of 

FIG- 3 according to an embodiment of the invention. 

[45] Pm. S IS a block diagram of a pipeline unit of the pipeline accaierator of 

FIG. 3 according to another embodiment of the inventioo- 
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|46j FIG, 6 is a block diagraoi of the pipeline acceJerator of FIG. 3 incfuding 

muitiple pipeline units according to an embodiment of the invention. 

[47J FIG, 7 is a biock diagram of the pipeline accelerator of FIO« 3 including 

multipie pipeHne units according to another embodiment of the invention, 

5 £483 FIG, 8 is a block diagram of tfie pipeline accelerator of FIG. 3 including 

groups of multiple pipeline units accordmg to an embodiment of the invention, 

DETAiLED DgSCRtPTiOM 

149} FIG, 3 is a schematic biock diagram of a computing machine 40, which 

has a peer-vector architecture according to an embodiment of the invention, tn 

10 addition to a host processor 42, the peer-vector machine 40 includes a pipeline 
acceferator 44, which performs at ieasta portion of the data processing, and which 
thus effectively replaces the bank of coprocessors 14 in the computing machine 10 
of FIG, 1 . Therefore, the host-processor 42 and the acceferator 44 (or units thereof 
as discussed below) are "peers" that can transfer data vectors back and forth. 

1 5 Because the acceferator 44 does not execute program instructions, it typicaiiy 

performs mathematically intensive operations on data significantly faster than a bank ■ 
of Goprocessors can for a given clock frequency. Consequently, by combining the 
decision-making abOEty of the processor 42 and the number-crunching ability of the 
accelerator 44, the machine 40 has the same abilities as, but can often process data 

20 faster than, a conventional computing machine such as the machine 10, 

Furthermore, as discussed below, providing the accetarator 44 with a Gommunicatlon 
interface that is compatibfe with the communication interface of the host processor 
42 faciHtates the design and modification of the machine 40, particularly where the 
processor's communication interface is an industry standard. And where the 

25 acceferator 44 includes multiple pipeline units (e.g., PLiC-based circuits), providing 
each of these units with the same communication interface facilitates the design and 
modification of the accelerator, particufarty where the communication interfaces are 
compatible with an industry^standandl interface. Moreover, the machine 40 may also 
provide other advanlages as described below and in the previously cited patent 

30 applications. 
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|50] StB! mferriog to FIG. 3, in addition to the host processor 42 and the 

pipefine accelerator 44, the peer-vector computing machine 40 in eludes a processor 
memory 46, an interface memory 48, a pipeline bus SO, one or more firmware 
memories 52, an optional raw-data input port 54, a processed-daia output port S8, 
5 and an optional router 61. 

[51] The host processor 42 indudes a processing unit 62 and a message 

handler 64, and the processor memory 46 includes a processing-unit memory 66 
and a handler memory 68, which respectively serv^e as both program and working 
memories for the processor unit and the message handler. The processor memory 
10 46 aiso inctiides an acceierator-configuration registry 70 and a 

message-Gonfigyration registry 72, which store respective configuration data that 
allow the host processor 42 to configure the functioning of the acceierator 44 and the 
format of the messages that the message handler 64 sends and receives, 

[521 The pipeline acceierator 44 is disposed on at feast one PLiC {FIG. 4) 

15 and tncfydes hardwired pipelines 74f - 74„, which process respective data without 
executing program instructions. The firmware memory 52 stores the configuration 
firmware for the accelerator 44. if the accelerator 44 is disposed on multiple PLiCs, 
then these PLICs and their respective firmware memories may be disposed in 
multiple pipeline units, which are discussed further below in conjunction with FIGS. 4 
20 - 8, AlternatiVeiy, the acceierator 44 may be disposed on at least one ASIC, and 
thus may have interna! interconnections that are unconfigurable once the ASIC is 
formed. In this alternative, the machine 40 may omit the firmware memory 52. 
Furthermore, although the acceierator 44 Is shown including multiple pipelines 74?* 
74,9, it may include only a single pipeline. In addition, aithough not shown, the 
25 accelerator 44 may include one or more processors such as a digital-signal 

processor (DSP), Moreover, aithough not shown, the accelerator 44 may include a 
data input port and/or a data output port, 

f53] And although the host processor 42 and pipeline accelerator 44 are 

discussed as being disposed on different fCs, the host pnD^cessor and pipeline 
30 accelerator may be disposed on the same IC- 

[54J The general operation of the peer-vector machine 40 is discussed in 

previously cited U.S, Patent App. Serial No. 10/684,102 entitled liVIPROVED 
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COMPUTING ARCHITECTURE AND RELATED SYSTEM AND METHOD, the 
structure and operation of the host processor 42 m discussed in previously cited U.S. 
Patent App. Seriai No.10/684,063 entitled COMPUTiNG MACHINE HAVING 
IMPROVED COMPUTING ARCHITECTURE AND RELATED SYSTEM AND 
5 yETHOD, and the structure and operation of the pipeline accelerator 44 is 
discussed tn previously cited U.S. Patent App, Serial No, 10/683,929 entitled 
PIPELINE ACCELERATOR FOR IMPROVED COMPUTING ARCHITECTURE AND 
RELATED SYSTEM AND METHOD and below in conjunction with FIGS. 4-8. 

|55| FJG. 4 is a block diagram of a unit 78 of the ptpefme accelerator 44 of 

10 FIG. 3 according to an embodiment of the Invention, 

[563 The accelerator 44 includes one or more such pipeline units 78 (only 

one shown in FIG, 4), each of v/hich includes a pipeline circuit 80, such as a PLIC or 
an ASIC. As discussed further below and in previously cited U.S. Patent App. Serial 
No. 10/683,929 entitled PIPELINE ACCELERATOR FOR IMPROVED COMPUTING 

1 5 ARCHITECTURE AND RELATED SYSTEM AND METHOD, each pipeline unit 7^ is 
a "peer" of the host processor 42 (FIG, 3) and of ttie other pipeline units of the 
accelerator 44. That Is. each pipeline unit 78 can communicate directly with the host 
processor 42 or with any other pipeline unit Thus, this peer-ve<Sor architecture 
prevents data "bottlenecks" that othenwlse might occur if all of the pipeline units 78 

20 communicated through a central location such as a master pipeline unit (not shown) 
or the host processor 42. Furthermore, this architecftire allows one to add or remove 
peers from the peer-vector machine 40 (FIG. 3) without significant modrficatlons to 
the machine. 

157] The pipeline circuit 80 includes a communication interface 82, which 

25 transfers data between a peer, such as the host processor 42 (FIG. 3), and the 

following other components of the pipeline circuit: the hardwired pipelines 74i-74„ via 
a communication shell 84, a pipeline controiier 86, an exception manager 88, and a 
configuration manager 90. The pipeline circuit 80 may also Include an 
industry-standard bus interface 91 and a communication bus S3, which connects the 
30 interface 82 to the interface 01. Alternatively, tiie functionality of the interface 91 
may be included within the communication Interface 82 and the bus 93 omitted. 
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[583 By designing the components of the pipeline circuit 80 as separate 

modules, one can often simpiily the design of the pipeline circuit That is, one can 
design and test each of these components separateiy, and then integrate them much 
iike one does when designing software or a processor-based computing system 
5 (such as the system 10 of FIG, 1). in addition, one can save m a library (not shown) 
hardware descnption language (HDL) that defines these components — paiiicxilariy 
components, such as the communication interface $2, that designers will probably 
use frequently In other pipeline designs — thus reducing the design and test time of 
future pipeline designs that use the same components. That is, by using the HDL 

10 from the library, the designer need not redesign pravtously impiemented components 
from scratch, and thus can focus his efforts on the design of components that were 
not previously implemented, or on the modification of previously imptemented 
components. Moreover, one can save in the library HDL that defines muitipte 
versions of the pipeline circuit SO or multiple versions of the entire pipeline 

1 5 accelerator 44 so that one can pick and choose among existing designs. 

[59] Still referring to FIG- 4, the communication interface 82 sends and 

receives (via the bus interface 9i of present) data in a format recognized by the 
message handler 64 {FIG, 3), and thus typically facilitates the design and 
modificatfon of the peer-vector machine 40 (FIG. 3). For example, if the data fomiat 

20 is an industry standard such as the Rapid i/O format, then one need not design a 
custom interface between the host processor 42 and the pipeline unit 7$ . 
Furthermore, by allowing the pipeline unit 78 to communicate with other peers, such 
as the host processor 42 (FIG. 3), via the pipeline bus SO instead of via a non-bus 
interface, one can change the number of pipeline units by merely connecting or 

25 disconnecting them (or the dncuit cards that hold them) to the pipeline bus instead of 
redesigning a non-bus intetface from scratch each time a pipeline unit is added or 
removed. 

[SO] The hardwired pipelines 74i-74^ perform respective operations on data 

as discussed above in conjunction with FIG. 3 and in previously cited U,S. Patent 
30 App. Serial Nos. 10/684,102 entitled IMPROVED COMPUTING ARCHfTECTURE 
AND RELATED SYSTEM AND METHOD and 10/683,929 entitled PIPELINE 
ACCELERATOR FOR IMPROVED COiVIPUTING ARCHITECTURE AND RELATED 
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SYSTEM AND METHOD, and the communication shelt 84 interfaces the pipelines to 
the other components of the pipeline circuit 50 and to other circuits (such as a data 
memory 92 discussed below) of the pipeline unit 78. 

[61] The controller 86 synchronizes the hardwired pfpeiines 74iJ4n in 

5 response to SYNC signals and special pipeline-bus communications {Lb., "events") 
from other peers, and monitors and controls the sequence in which the pipelines 
perform their respective data operations. For example, a peer, such as the host 
processor 42, may pulse a SYNC signal or send an event to the pipeline unit 75 via 
the pipeline bus 50 to indicate that the peer has finished sending a block of date to 

10 the pipeime unit and to cause the hardwired pipelines 74iJ4n to begin processing 
this data. Typically, a SYNC signal is used to synchronize a time-cri«ca[ operation, 
and an event is used to synchronize a non-time-critica! operation. Typically, an 
event is a data-less communfcation that is ofl^n called a "doorbeir*. But an event 
may include data, in which case it is often calSed an "event message'*. SYNC signals 

15 and events are discussed further in previously cited U:S. Patent App, Serial No, 
10/683,929 entitfed PIPELINE ACCELERATOR FOR IMPROVED COyPUTING 
ARCHITECTURE AND RELATED SYSTEM AND METHOa 

|623 The exceptjon manager 88 monitors the status of the hardwired 

pipelines 74i-74n. the communication interlace 82, the commynication shell 84, the 

20 controller BB, and the bus interface Qi (if present), and reports exceptions to the host 
processor 42 (FIG, 3). For example, if a buffer in the communication interface 82 
overflows, then the exception manager 88 reports this to the host processor 42, The 
exception manager may also conrect, or attempt to correct, the problem giving rise to 
the exception. For example, for an overflowing buffer, the exception manager 88 

25 may increase the size of the buflBr, either dinectiy or via the conHguration manager 
BO as discussed below, 

|63| The configuration manager 90 sets the soft configuration of the 

hardwired pipelines 74r74n, the communication interface 82, the communication 
shell 84, the controller 86, the exception manager 88, and the interface 91 (if 
30 present) in response to soft-configuration data from the host processor 42 (FIG. 3) — 
as discussed In previously cited U.S. Patent App. Serial No, 10/684,102 entitled 
IMPROVED COMPUTING ARCHiTECTURE AND RELATED SYSTEM AND 
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METHOD, the hard configuration denotes the actual topoiogy, on the transistor and 
circuit-block leva!, of the pipeyne circuit SO, and the soft configuration denotes the 
physical parameters (e.g., data width, table size) of the hard-configured components. 
That is, sot configuration data is simHarto the data that can be loaded into a register 
5 of a processor (not shown in FIG. 4) to set the operating mode (e.g., burst-memory 
mode) of the processor. For exampie, the host processor 42 may send 
solt-conff gyration data that causes the configuration manager 00 to set the number 
and respective priority levels of data and event qiieuas in the communication 
interface 82. The exception manager 8S may also send soft-configuration data that 
10 causes the configuration manager 90 to, e.g., increase the sfze of an overflowing 
buffer in the communication interface 82. 

|641 The industry-standard bus interface §1 is a conventional busnnterface 

circuit that reduces the sfee and complexity of the communication interface 82 by 
effectively offloading some of the interface circuitry from the communication 

15 interface. Therefore, if one wishes to change the parameters of the pipeline bus 50 
or router 61 (FIG. 3), then he need oniy modify the interface 91 and not the 
communication interface 82. Alternativoiy, one may dispose the interFace 91 m an IC 
(not shown) that is external to the pipeSine circuit 80. Offloading the interface 91 
from the pipeline circuit 80 frees up resources on the pipeline circuit for use in, e,g,, 

20 the hardwired pipelines 74^74^ and the controller 86. Or, as discussed above, the 
bus interface 91 may be part of the communication interface S2> 

[65] StMl referring to FIG, 4» in addition to the pipeiine circuit 80, the pipeline 

unit 78 of the accelerator 44 includes the data memory 32, and, if the pipeline circuit 
IS a PLIC, a fimiware memory 5Z 

25 [66] The data memory 92 buffers data as it flows between another peer, 

such as the host processor 42 (FIG. 3), and the hardwired pipelines 74r74fj, and is 
also a working memory for the hardwired pipelines. The commynlcation interface 82 
Interfaces the data memory 92 to the pipeSfne bus 50 (via the communicalion bus 94 
and industry-standard interface 91 if present), and the communication sheii 84 

30 interfaces the data memory to the hardwired pipelines 74^74^* 

f67| The data memory 92 (or other portion of the pipeline unit 78) may also 

store a profile of the pipeline unit The proflte describes the pipeline unit 78 
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sufficiently for the host processor 42 (FIG* 3) to appropriatety configure Itself, the 
pipoHne unit, and other peers of the peer-vector machine 40 (FIG, 3) for 
intercommunication. For example, the profile may identify the data operations and 
communioation protocoSs that the pipeiine unit 7$ is capable of imptementing. 
Consequently, by reading the profite during initialization of the peer^vactor machine 
40, the host processor 42 can properly configure the message handler 64 (FIG. 3) to 
communicate with the pipeline unit 78. This technique is analogous to the ""plug and 
play technique by which a computer can configure Itseif to commynicate mth a 
ne\¥ly instaiied peripheral such as a disk drive. Configuration of the host processor 
42 and pipeline unit 78 are discussed ftjrther in previously cited U.S, Patent App, 
Serial Nos. 10/684,102 entitled IMPROVED COMPUTING ARCHITECTURE AND 
RELATED SYSTEM AND METHOD and 10/684,057 entitied PROGRAMMABLE 
CIRCUIT AND RELATED COMPUTING MACHINE AND METHOD, 

[68] As discussed above in conjunction with FIG, 3, where the pipeiine 

circuit 80 is a PLiC, the firmware memory 52 stores the firmware that seta the hard 
configuration of the pipeline circuit. The memory 52 loads the firmware into the 
pipeline circuit SO during the configuration of the accelerator 44, and may receive 
modifted fimnware from the host processor 42 (FIG, 3) via the communication 
intejface 82 during or after the configuration of the accelerator. The loading and 
receMng of firmware is further discussed in previousiy cited U.S. Patent App. Serial 
Nos, 10/684,102 entrtled iypROVED COMPUTING ARCHITECTURE AND 
RELATED SYSTEIVJ AND METHOD, 10/684,053 entitled COMPUTING MACHINE 
HAViNG IMPROVED COMPUTING ARCHITECTURE AND RELATED SYSTEM 
AND METHOD, and 10/684.057 entitled PROGRAMMABLE CIRCUIT AND 
RELATED COMPUTING MACHINE AND METHOD. 

C69J Still referring to FIG* 4, ttie pipeiine unit 78 may Include a circuit board 

or card 98 on which are disposed the pipeline circuit SO, data memory 92, and 
firmware memory 52, The circuit board 98 may be plugged into a pipeline-bus 
connector (not shown) much like a daughter card can be plugged into a slot of a 
mother board in a personai computer (not shown). Although not shown, the pipeiine 
unit 78 may include conventionat ICs and components such as a power regulator 
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and a power sequencer; these tCs/coinponents may aiso be disposed on the card 98 
as is known, 

[703 Further details of the structure and operatton of the pipeline unit 78 are 

discussed in previously cited U.S- Patent App, Serial No, 10/683,929 entitled 
PIPELtHE ACCELERATOR FOR SMPROVED COMPUTING ARCHITECTURE AND 
RELATED SYSTEM AND METHOD, 

[71] FIG. 5 is a block diagram of a pipeline unit 100 of the pipeiine 

accelerator 44 of FIG. 3 according to another embodsment of the invention. The 
pipeline unit 100 is similar to the pipeline unit 78 of FIG- 4 except that the pipeline 
unit 100 includes multiple pipeiine clrcuEts SO ~ here two pipeHne circuits SOa and 
80b. increasing the number of pipeline circuits 80 typically allows an Increase m the 
number n of hardwired pipeiines 74i-74n, and thus an increase in the functfonality of 
the pipeSine unit 100 as compared to the pipeiine unit 7a Fyrthemfiore, the pipeline 
unit f 00 inciudes a firmware memory S2a for the pipeline circuit SOa and a firmware 
memory S2t for the pipeline clrouit 80b. Alternatively, the pipeJine cimyits SOa and 
80b may share a single firmware memory. 

[72| In the pipeline unit 100, the sen/lces components, Le., the 

communication interface 62, the controlier 80, the exception manager 88, the 
configuration manager 90, and the optional Industry-standard bus interface 91, are 
disposed on the pipeline circuit SOa, and the pipelines 74i-74n and the 
communication sheff 84 are disposed on the pipeline circuit 8Qb. By ioc^^ting the 
servrces components and the pipelines 74r74n on separate pipeline circuits 80a and 
80b, respectively, one can Include a higher number n of pipelines and/or more 
complex pipelines than ha/she can where the service components and the pipelines 
are located on the same pipeline circuit. Afternativefy, the portion of the 
commynicatjon shell 84 that interfaces the pipelines 74r74n to the interface 82 and 
to the controlfer 86 may be disposed on the pipeline circuit 80m. 

JT31 Further details of the structure and operation of the pipeline unit f 00 

are discussed in previously cited U.S. Patent App. Serial No, 10/683,929 PfPELINE 
ACCELERATOR FOR IMPROVED COMPUTING ARCHITECTURE AND RELATED 
SYSTEM AND METHOD, 
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[74] FIG. S is a block diagraoi of the acceterator 44 of FIG, 3 having 

multiple pipeline units 7$ (FIG. 4) or 100 (FIG. 5) according to an embodiment of the 
invention. For ciarity, the accelerator 44 is discussed as having multiple pipeline 
units 78i - 78n, ft being understood that the accelerator may indude multiple pipeline 
5 units 100 or a combination of units 78 and 100: By indudlng multiple pipeline units 
78, one can increase the functionality and processing power of the accelerator 44 as 
compared to an accelerator having only one pipeline unit. Furthermore, because 
each pipeline unit 70 typicaliy has a common industry«standard interface, one can 
easily modify the accelerator 44 by adding or removing plpefine units. 

1 0 |7S] \n one impiemenlafion of the muStipla-pipeline accelerator 44, the 

industry-standard bus interface 91 is omitted from each pipeiine unit 78i - 78a, and a 
single externa! (to the pipeline units) interface 91 and communication bus 94 are 
common to all of the pipetlne units, inciuding a single external bus interface 91 frees 
up rasources on the pfpelina circuits 80 (FIG. 4) as discussed above In conjunction 

15 mth FIG. 4. The pipeline units 78^ - 78^ may all be disposed on a singie circuit 
board (not shown In F!G, 6)> each pipeiine unit may be disposed on a respective 
circuit boardj or groups of multiple pipeiine units may be respectively disposed on 
multiple circuit boards. In the tatter two Implementations, the bos interface 91 is 
disposed on one of the circuit boards. Alternatively, the pipeiine units 78f - 78n may 

20 each include a respective industry-standard bus interface 91 as discussed above in 
conjunction with FIG. 4, and ttius may each communicate directfy with the pipeiine 
bus 90 or router «t (FIG. 3)* In this implementation, the pipeline units 78i - 78^ may 
be disposed on a singie or multiple circuit boards as discussed above. 

|76] Each of the pipeline units 78i - 75^ is a peer of the host processor 42 

26 (FIG- 3) and of each other. That is, each pipeline unft 78 can communicate directly 
With any other pipeline unit via the communication bus 94, and can communicate 
with the host processor 42 via the communication bus 94, the bus interface 91, the 
router 61 (if present), and the pipeiine bus 50. Aiternativeiy, where the pipeline units 
78i - 78n each include a respective bus interface 91, then each pipeline unit can 
30 communicate directly with the host processor 42 via the rt^uter 61 (if present) and the 
pipeline bus 50. 
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[77] The operatEon of the myltl«pipellne-unjt aocelerator 44 is now described 

by way of two examples. 

[78| In a first example, the pipeline unit 78i transfers data to the pipeHne 

78^, which processes the data in a time-ciitlca} manner; thus, the pipeline units 78i 
5 and 78ft use one or more SYNC signals to synchnonke the data transfer and 

processing. Typically, a SYNC signal is fast enough to trigger a time-critical function, 
but requires significant hardware resources; comparativefy, an event typicaHy is not 
fast enough to trigger a time-critScal function, but requires significantfy fewer 
hardware resources. As discussed in previousiy cited U.S. Patent App. Serial No. 

1 0 1 0/683,929 entitled PiPELINE ACCELERATOR FOR IMPROVED COMPUTING 

ARCHITECTURE AND RELATED SYSTEM AND METHOD, because a SYNC signal 
Is routed directly from peer to peer, it can trigger a function more quickiy than an 
event which traverses, e.g., the pipeline bus 50 (FfG, 3), and the communication 
bus 94. But bBcausa they are separately routed, the SYNC signals require 

15 dedicated circuitry, such as routing lines and buffers of the pipeline circuit 80 (FIG* 
4)- Conversely, because they use the existing data4ransfer infrastructure (e.g. the 
pipeline bus 50 and the communication bus 94), the events require fewer dedicated 
hardware resources. Consequently, designers tend to use events to trigger a!i but 
the mast time-critica! functions* 

20 [70| First, the pipeline unit 78i sends data to the pipeline unit 78n by driving 

the data onto the communication bus M Typically, the pipeline unit 78i generates a 
message that includes the data and a header that contains the address of the 
pipeline unit 78», If the pipeiine unit 78f were to send the data to multiple pipeline 
units 78, then it may do so in one of twom'ays. Speclficaily, the pipeline unit 78? may 

25 sequeotiaiiy send separate messages to each of the destination pipefine units 78, 
each message incfyding a header containing the address of a respective destination 
unit. Aiternativaty, the pipeiine unit 78i may simuitaneousfy send the data to each of 
the destination pipeline units 78 by inciuding in single nnessage the data and a 
header containing the addresses of each destination pipeline unit The sending of 

30 data is further discussed m previously cited U.S. Patent App. Senai No. 10/683,929 
entitied PIPELINE ACCELERATOR FOR IMPROVED COMPUTING 
ARCHITECTURE AND RELATED SYSTEM AND METHOD, 
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[80| Next, the pSpeiine unit 78^ receives the data. Because the pipeilne 

units 78i - 78n are each coupled to the common commynicatioo bus 94, each 
pipef ine unit 7^2 - 7S^ determines whether or not it is an intended recipient of the 
data. For example, each pipeline unit 782 - 7S« determines whether its address fs 
inctuded in the header of the message. In this example, the units 782 - 78n^i 
determfne that they are not Intended recipients of the data, and thus ignore the data, 
Le, , do not load the data into their data memories 92 (FIG* 4). Conversely, the 
pipeyoe unit 78f) determines that It is an intended recipient of the data^ and thus 
bads the data into its data memory 92, The receiving of data is discussed further in 
U,S, Patent App. Senal No. 10/683,929 entitled PlPELiNE ACCELERATOR FOR 
iMPROVED COMPUTiNG ARCHITECTURE AND RELATED SYSTEM AND 
METHOD. 

[81 3 Th^n, when the pipefine unit 78ft is ready to process the received data, 

a peer, such as the pipefine unit 78f, or an externa! device (not shown) pulses a 
SYNC signal to cause the pipeline unit to process the data m a timeiy manner. 
There exist a number of techniques by which the peer/device that puises the SYNC 
signal may determine when the pipefine unit 78n is ready to process the received 
data. For example, the peer/device may merely putse the SYNC signal a 
predetermined time after the pipeline unit 78t sends the data. Presumably, the 
predetermined time is long enough to allow the pipeline unit 78^ to receive and load 
the data into its data memory 92 (FIG. 4)> Alternatively, the pipeline unit 7S„ may 
pulse a SYNC signal to inform the peer/device that it is ready to process the received 
data, 

[82] Next, in response to the pulsed SYNC signal, the pipefine unit 7S„ 

processes the received data. The prooesslng of data by a plpeiine unit is discussed 
further in piBvlousty cfted U.S. Patent App. Seriai No. 10/683,929 entitled PIPELINE 
ACCELERATOR FOR IMPROVED COMPUTiNG ARCHITECTURE AND RELATED 
SYSTEM AND METHOD. 

[83] Then, when the pipeline unit 7S„ is finished processing the data, a 

peer, an external device (not shown), or the unit 78« itself may puise a SYNC signal 
to notify the pipeline unit 78i to send more data* 
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[843 In a second exampfe, the host processor 42 {FIG. 3) transfers data to 

the pipefine 78„, which processes the data in a r^on-tlme-criticat manner; thus the 
host processor and the pipeiine unit 78^ use one or more events to synchronize the 
data transfer and processing for the reasons discussed above. 

5 [85| First the host processor 42 (FIG. 3) sends data to the pipeffna unit 7$n 

by driving the data onto the pipeline bus 50 (FIG. 3), Typjcaify, the host processor 
42 genterates a message that includes the data and a header containing the address 
of the pipeline unit 78n* if the host processor 42 were to send the data to multiple 
pipeline units 78, then it n^ay do so in one of the two ways discussed above in 
1 0 conjunction with the first example- 

J86J Next, the pipeline unit 78fj receives the data from the pipefine bus 50 

{FIG> 3) via the industry-standard bus interface 91 and the communication bus 94. 
Because the pipeHne units 78i - 78n are each coupled to the common 
communication bus 94, each pipeline unitdetarmfnes whether it is an intended 
1 5 recipient of the data in the manner discussed above in Gonjunction with the first 
example. 

[871 Then, when the pipeline unit 7a„ Is ready to process the received data, 

a peer, such as the host processor 42 (FIG. 3), or an externa! device (not shown), 
generates an event on the pipeline bus 50 or directiy on the communication bus 94 

20 to cause the pipeline unit 7Sn to process the data in a timely manner. There exist a 
number of techniques by which the peer/device that generates the event may 
determine when the pipeline unit 78n is ready to process the received data. For 
exampie, the pear/device may merely generate the event a predatannined time ater 
the host processor 42 sends the date. Presumably, the predetermined time is long 

25 enough to allow the pipeHna unit 78^ to receiva and load the data into its data 

memory 92 (FIG. 4). Alternatively, the pipeiine unit 7^ may generate an event to 
inform the peer/device that it is ready to process the received data. 

[S8J Next, the pipeline unit 78n receives the event. The receiving of an 

event is discussed in previously cited U.S. Patent App. Serial NoJ 0/683,929 entitled 
30 PiPEUNE ACCELERATOR FOR IMPROVED COMPUTING ARCHITECTURE AND 
RELATED SYSTEM AND METHOD. 
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[89] Then, in response to the received event the pipeline unit 78^ 

processes the received data. The prooessing of data by a pipeline unit 78n is 
discussed further In previously cited U,S. Patent Application Serial No, 10/683,829 
entitled P!PELiNE ACCELERATOR FOR IMPROVED COMPUTING 
5 ARCHITECTURE AND RELATED SYSTEM AND METHOD, 

[903 Next, when the pipeline unit 7S„ is finished processing the data> a peer, 

an external device (not shown), or the unit 78n itself may generate an event to notify 
the host processor 42 {FIG. 3) to send more data. 

[91] Still referring to FIG. 6, aiternative impiementations of the accelerator 

10 44 are oontempiated. For example, although the above-discussed first and second 
exampfes of operation respectiveiy use SYNC signafs and events exctusiveiy, St is 
contempiated that the accelerator 44 can use both SYNC signals and events in 
combination. Furthermore, other peers can use one or more of the muitipie pipefine 
units 78 or 100 merely for bulk storage of data in their respective data memories 92. 
15 In addition, a designer may replace the host processor 42 (FIG* 3) with one or more 
of the pipeline units 70 or fOO, which together form a ""hosf peer that performs the 
functions of the host processor. Moreover, one or more of the pipeline units 78 or 
f 00 may act as one or more message-distnbutjon peers. For example, suppose that 
the host processor 42 generates a message for transmission to multipfe subscriber 
20 pears. The host processor 42 may send the message to a message-distribution 
peer, which then distributes the message to each of the subscriber peers. 
Consequentfy, the message-distribution peer, not the host processor 42, undertakes 
the burden of distributmg the message, and thus allows the host processor to devote 
more time and resources to other tasks. 

25 [92] FIG. 7 is a block diagram of the accalerator 44 (FIG, 3) having multiple 

pipefine units 78 (FIG- 4) or 100 (FIG. 5) according to another embodiment of the 
invention. 

i93J The accelerator 44 of FIG, 7 is the same as the accelerator 44 of FIG. 

6, except that the acoeierator 44 of FIG. 7 includes a communication-bus router 110 
30 for routing data between the pipeline units 78i - 7S» and other peers, such as the 
host processor 42 {FIG. 3), and devices (not shown) that are coupled to the pipeline 
bus 50 (FIG. 3). For clarity, the accelerator 44 of FIG. 7 Is discussed as having 
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muitiple pipeline units 78i - 78n, St being understood that the acceiarator may inciude 
muKiple pipeline units 100 or a combination of units 78 and 100, 

|94] The Gommunicatfon-bus router HO is coupied to the pipelEne units 7Si 

- 78n via respecKve branches 94i - 94n of the communication bus 94, and is coupled 
5 to the industry-standard bus interface 91 (if present) via a bus 112. Alternatively, as 
discussed above in conjunction with FIG* 6, each pipeline unit 76i - 78a may include 
a respective interface 91 on board, and thus the external interface 91 can be omitted 
such that the router 110 Is directly coupled to the pipeline bus 50 (or router 61 if 
present) of FIG. 3* 

10 195] The router 110 routes signals from the pipeiine bus 50 (FIG. 3) to the 

respective destination pipeline unit or units 78i - 78^ and also routes signals from a 
source pipeiine unit to one or more destination pipeiine units or to the pipeline bus, 
Consequentfy, the router t t0 offloads from each of the pipeiine units 78i-78n the 
function of determining whether a signal on the communication bus 94 is intended for 

15 that pipeline unit. This offtoeding may free up resources on the pipeline circuit 80 
{PiG. 4) of each pipetina unit 78i - 7S«, and thus may allow an increase in the 
functionalSty of each pipeline unit. 

|96j Stii! referring to FIG. 7, the operation of the multi-plpeline-unit 

acceierator 44 with the router liO is now described. Because the operation is 
20 similar to that described above for the acceterator 44 of FIG. 6. the befow description 
highfights the operational differences between the accelerators of FIGS, 6 and 7. 

[97] In a first example, the pipeline unit TSf transfers data to the pipeline 

7Sf,, which processes the data m a time-critical manner; thus, the pipeline units 78i 
and 78n use one or more SYNC signals to synchronize the data transfer and 
25 processing as discussed above in conjunction witii the first example of FIG* 6. 

[981 fitBt, the pipeline unit 78i sends data to the pipeline unit 78n by driving 

the data onto the branch 94i of the communication bus. Typfcafly, the pipeiine unit 
78i genarates a message that incfudes flie data and a header that contains the 

address of the pipeiine unit 7Srt. 

30 f99] Next, the router 110 receives the data, determines that the destination 

of the data is the pipeline unit 78^* and drives the data onto the branch 94^ of the 
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communication bus. Typtoaiiy, the router 110 detemilnes the destination of the data 
by analyzing the header of the message containing the data and extracting the 
destination address from the header. Consequently, because the router 110 
determines the proper destination of the data, the pipeflne unit 78^ can mereiy 
5 accept the data from the router without determining whether it is an intended 

recipient of the data. Alternativefy, the pipeline 78^ may determine whether It Is an 
intended recipient of the data, and generate an exception (discussed in previously 
cited U.S- Patent App, Serial Nos, 10/684,102 entitled fMPROVED COypUTING 
ARCHITECTURE AND RELATED SYSTEM AND METHOD, 10/684,063 entitled 

10 COMPUTfNG MACHiNE HAVING IMPROVED COMPUTING ARCHITECTURE AND 
RELATED SYSTEM AND METHOD, and1 0/683,929 entitied PiPELfNE 
ACCELERATOR FOR IMPROVED COMPUTING ARCHITECTURE AND RELATED 
SYSTEM AND METHOD if it js not an intended recipient. The pipeline unit 78n can 
send this exception to the host processor 42 {FfG* 3) via the noyter 110, the 

15 Industry-standard bus interface 97 {ff present), the router 6f (If present), and the 
pipeline bus 50 (FIG, 3). 

[100] Then, the pipeline unit 78^^ ioads the data from the bus bnanch 94^,. 

The loading of data by a pipeline unit Is further discussed in previously cited U,S, 
Patent App. Seria! No. 10/683,929 entitled PIPELINE ACCELERATOR FOR 
20 IMPROVED COiVlPUTING ARCHfTECTURE AND RELATED SYSTEM AND 
METHOD. 

|101] Next, when the pipeline unit 78n Is ready to process the received data, 

a peer, sudh as the pipefine unit 78?, or an external device (not shown) pulses a 
SYNC signal to cause the pipeline unit 78n to process the data in a timely manner as 
25 discussed above in conjunction with the first example of FIG. 6. 

{102] Then, in response to the pulsed SYNC signal, the pipeline unit 7$^ 

processes the received data as discussed above in conjunction with the first 
exampfe of FIG* 6, 

[1031 Next, when the pipeline unit 7£f« is finished processing tie data a peer, 

30 an e>derna{ device {not shown), or the unit 78a itself may pulse a SYNC signai to 
notify the pipeline unit 78i to send more data* 

25 
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{1043 In a second exam pie, the host processor 42 (FIG. 3) transfers date to 

the pipeline 78n, which processes the data in a non»time-critica! manner; thus the 
host processor and the pipeiine unit 78n use one or more events to synchronize the 
data transfer and processing for the reasons discussed above In conjunction with 
5 Fia 6, 

[1 05] First J the host processor 42 (FIG. 3) sends data to the pipeline unit 78n 

by driving the data onto the pipeline bus SO {FIG* 3). TypicaHy, the host processor 
42 generates a message that includes the data and a header containing the address 
of the pipeline unit 7S«. 

10 [106| Next, the royter 110 receives the data from the pipeline bus SO (PiG. 3) 

via the industry-standard bus interface 91 (if present) and the bus 112. 

|1 07] Then, the router HO determines that the destination of the data is the 

pipeline unit 7Bm and dnves the data onto the branch 94n of the communication bus. 
Typicaify, the router 110 determines the destination of the header as discussed 

15 above m conjunction v^ith the first example of FIG. 7. Consequentfy, because the 
router HO determines the proper destination of the data, the pipeiine unit 78n can 
merely accept the data from the router without determining whether ft is an intended 
recipient of the data. Alternativeiy, the pipeline 78^ may determine whether it is an 
intended recipient of the iia^, generate an exception (discussed in previously cited 

20 U.S. Patent App, Serial Nos, 10/684,102 entitied iMPROVED COMPUTING 

ARCHITECTURE AND RELATED SYSTEM AND METHOD, 10/684,053 entitled 
COMPUTING yAGHINE HAVING IMPROVED COMPUTING ARCHITECTURE AND 
RELATED SYSTEM AND yETHOD, and 10/683,929 entitied PiPELSNE 
ACCELERATOR FOR tMPROVED COMPUTING ARCHITECTURE AND RELATED 

25 SYSTEM AND METHOD if it is not an fntended recipient, and send the exception to 
the host processor 42 (FIG. 3) as discuaaed above in con|unction v^iih the second 
example of FIG. 6* 

[108] Next, the pipeline unit 78n toads the data from the bus branch The 

loading of data by a pipeline unit is further discussed in previousiy cited U,S. Patent 
30 App. Seriai No, 10/683,929 entitied PiPEUNE ACCELERATOR FOR IMPROVED 
COMPUTiNG ARCHITECTURE AND RELATED SYSTEM AND METHOD, 
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[109] Then, when the pipeiioe unit 78n is ready to process the received data, 

a peer, such as the host processor 42 (FIG. 3), or an axternaJ device (not showi), 
generates an event on the pipeline bus 50 or on one of the branches 94i - of 
the communication bus to cause the unit 7$n to process the data in a time!y manner 
5 as discussed above in conjunction with the second exampie of FIG. 6, 

[110] Next, the router 110 receives the event, determines that ft is intended 

for the pipeline unit 75^,, and drives the event onto the bus branch 

[111 1 Then, the pipeNne unit 78ti loads the event from the bus branch 94. 

The loading of an event by a pipeline unit 78 is discussed in previousiy cited U.S. 
10 Patent App. Sena! No. 10/683,929 entitled PiPELiNE ACCELERATOR FOR 
IMPROVED COMPUTllNIQ ARCHITECTURE AND RELATED SYSTEy AND 
METHOD. 

[11 2| Next, in response to the received event, the pipeline unit 78^ processes 

the received data, 

15 [1 131 Then, when the pipeflne unit 78„ Is finished processmg the data, a 

peer, an externa! device (not shown), or the unit 78„ itself may generate an event to 
notify the host processor 42 (FIG* 3) to send more data. 

[114] Stitl referring to FIG. 7, although the first and second examples of 

operation respectiveiy use SYNC signais and events exdusivety, it is contempfated 
20 that the accelerBtor 44 can use a combination of both SYNC signals and events. 

f 1 1 5] FIG- 8 is a block diagram of the accelerator 44 of FIG. 3 including 

multiple groups f20 of multiple pipeline units 78 (FIG. 4) or 100 (FIG* 5) according to 
an embodiment of the invention. Sncfuding multiple groups 120 of pipeline units 
increases the functionality of the accelerator 44, and allows a designer to increase 

25 the acceierator's efficiency by grouping plpeiine units that perform related 

operations. For clarity, the acceierator 44 of FIG, 8 is discussed as having muftiple 
pipeline units 78, it being understood that the acoeterator may include muttipla 
pipeline units 100 or a combination of units 78 and 100. Furthermore, the pipeline 
units 78 do not include industry-standard bus intarfaces 91 (this interface is externa} 

30 in this embodiment), although they may in another embodiment. 
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[1 16] The acceierator 44 inciudes six groups 120i - 120e of pipeline units 78, 

each group having three pipeline units and a respective intra-group 
communlcatton~bus router 110i - llOe that interGonnects the pipeiine units to each 
other and to the other pipeiine-unit groups. Although the acoeterator 44 is discussed 
as induding six groups 120i - 120$ of three pipeiine units 78 each, other 
impiementatioos of the accelerator may mclude virtually any number of groups of any 
number pipeline onits, and not all the groups need have the same number of pipeiine 
units. Furthermore, the communiGation-bus routers 110i-110$ may be omitted as 
discussed above in conjunction with the accelerator 44 of FIG- 6* 

J1173 The pipeline*unit group 120i includes three pipeiine units 78i - 7Ss, 

which are connected to an intra-group communication-bus router f f Of via brandies 
94i, 942, and 9% respectively, of a communication bus in a manner similar to that 
discussed above in conjunction with FIG, 7. The otfier groups I2O2 - 120^ are 
simiiar. 

|1181 The communication-bus routers If Of - 110^ of the groups 120i - I2O2 

are connected to a flrst-ieval router 122i via respective branches 124i - 124^ of a 
first-level bus f 26f , The router 122i and bus f 26f allow the pipeiine units 7Bi - 78^ 
to communicate with each other 

[11 03 Simyarly, the communication-bus nouters IIO4 - 110b are connected to 

a first-levei router 122s via respective branches 128^ - 1283 of a first-fevef bus 12$2^ 
The router 1222 and bus 126^ ajlow the pipeiine units 78w - 78fB to communicate 
with each other. 

{120| The first-ievet routers 122^ and 1222 ana connected to a second-levei 

router f 30 via respective branches 132i - i32z of a second-level bus 134. The 
router f 30 and bus 134 allow the pipeline units 78t - 7Sfs to communicate with each 
other and with other peers/devices as discussed below, 

11213 The pipeiine bus SO and a secondary pipeline bus 136 are coupied to 

the second-ievei router 130 via the respective industry-standard bus interfaces 01 1 
and 9f ^ The secondary pipeline bus 138 may be connected to peers, such as the 
host processor 42 (FfG. 3), or penpherais, such as a hard-disk drive {not shown), 
that are not coupled to the pipeline bus m Furthermore, either or both of the 
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busses 50 and f 36 may be ooupied to pears or peripherafs via a network or the 
internet (neither shown) such that the accelerator 44 can be remotely located from 
other peers, such as the host processor 42 (FIG, 3), 

[122] A bus f 38 directly connects one or more SYNC signals to all of the 
5 pipeline units 78^ - 78^ and to other peers, such as the host processor 42 (FIG, 3), 
or devices (not shown)* 

[123| Still referring to F!G« 8, in one example of operation, each group 120^ - 

120$ of pipeline units 78 processes data from a respective sensor of a sonar array 
(not shown) that is coupled to the secondary pipeline bus 136. Because the pipeline 

10 units 78i - 78$ of the group 120i are interconnected by a singie router IIOi, these 
pipeline units can commynlcate with each other more quickfy than they can with the 
pipeline units 704 - 78is of the other groups I2O2 - 120e. This higher communication 
speed is aiso present In each of the other groups 12O2 - 120$, Consequently, a 
designer can increase the processing speed of the accelerator 44 by grouping 

1 5 together pipeline units that frequentty transfer data or otherwise communlcata among 
themselves. 

[1243 In general, the pipeline units 78i - 78i8 communicate with each other 

and with peers, such as the host processor 42 (FIG. 3), and devices coupled to the 
buses 50 and 136 in a manner similar to that discussed above in conjunction with 
20 FIG* 7, For example^ a sensor (not shown) coupfed to the bus f 30 communicates 

with the pipeiine unit 78f via the industn,/-standard bus interface 9f the 
second-teve! router 130, the first tevel router 122-}, and the intra-group router llOf. 
Similariy, the pipeiine unit 78i communicates with the pfpefine unit 787 via the routers 
ilOi, 122i, and 110^^ and communicates with the pipeline unit 75fo via the routers 
25 f f Of, 122i, 130. 1222. and ftO^- 

f1253 The preceding discussion is presented to enabfe a person skilled m the 

art to make and use the invention. Various modifications to the embodiments wili be 

readily apparent to those skilled in the art, and the generic principles herein may be 

applied to other embodiments and applications without departing from the spirit and 

30 scope of the present invention. Thus, the present invention is not intended to be 

limited to the embodiments shown, but is to be accorded the v^^dest scope consistent 

with the principfes and features disclosed herein. 
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WHAT !S CLAIMED IS: 

1 . A pipeline accelerator, comprising: 
a communication bus; and 

a plurality of pipeline units each coupled to the comnnunicatbn bus and each 
5 comprising a respective hardwired-pipeline circuit* 

2, The pipeline accelerator of claim 1 wherein each of the pipeline units 
comprises: 

a respective memory coupled to the hardwired-pipeline circuit; and 
wherein the hardwired-pipeline circuit is operable to, 
10 receive data from the communication bus, 

load the data into the memory, 

retrieve the data from the memory, 

process the retrieved data, and 

drive the processed data onto the commonication bus. 

15 3, The pipeline accelerator of claim 1 wherein each of the pipeline units 

comprises: 

a respective memory coupled to the hardwired-pipenna circuit; and 

wherein the hardwired-pipefine circuit is operable to, 

receive data from the communication bus, 
20 process tiie data, 

load the processed data into the memory, 
retrieve the processed data from the memory, and 
load the retrieved data onto the Gommunication bus. 

4. The pipeline aooelerator of ciaim 1 wherein each of the 
25 hardwtred-pipefine ctraiits is disposed on a respective field-programmable gate 
array, 

6. The pipeline accelerator of oialm 1 , further comprising: 

a pipeline bus; and 

a pipelme-'bus interface coupled to the communication bus and to the pipeline 

30 bus, 

30 
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6. The pipeline accelerator of claim 1 . further comprising: 

wherein the communication bus comprises a plurality of branches, a 
respective branch coupled to each pipeline unit; and 
a muter coupled to each of the branches. 

5 7, The Pipeline accelerator of claim 1 , further comprising: 

wherein the communication bus comprises a piurality of branches, a 
respective branch coupled to each pipeline unit; 
a router coupled to each of the branches; 
a pipeline bus; and 

10 a pipeline-bus interface coupled to the router and to the pipeline bus, 

8. The pipeline accelerator of claim 1 , ftirther comprising: 

wherein the communication bus comprises a pfurality of branches, a 
respective branch coupled to each pipeline unit; 
a router coupled to each of the branches; 
15 a pipeline bus; 

a pipeline-bus Interface coupfed to the router and to the pipeline bus; and 
a secondary bus coupled to the router. 

9. The pipeline accelerator of claim 1 wherein: 

the communicaion bus is operable to receive data addressed to one of the 
20 pjpeiine units; and 

the one pipeline circuit js operable to accept the data; and 
the other pipeline circuits are operable to reject the data* 

1 0. The pipeline accelei^tor of claim 1 , further comprising: 

wherein the communjcatton bus comprises a plurality of branches, a 
25 respective branch coupled to each pipefine unit; 

a router coupled to each of the branches and operable to, 

receive data addressed to one of the pipeline units, and 
provide the data to the one pipeline unit via the respective branch of 
the communication bus* 

30 11 . A computing machine, comprising: 

31 



wo 2004/0425<:>1 



FCr/US2003/034555 



a processor; 

a pipeline bus coupied to the prooassor; and 
a pipafine accelGrator comprising, 
a communication bus, 
5 a pipeline*bys interlace coupled between the pipeline bus and the 

communication bus, and 

a pluraiity of pipeline units each coupied to the communicatton bus and 
each comprising a respective hardwired-pipefine circuit 

1 2- The computing machine of clam 1 1 wherein: 

10 the processor is operable to generate a message that identifies one of the 

pipeline units and to drive the message onto the pipeline bus; 

the pipe!ine-bus interface is operable to coupie the message to the 
communication bus; 

the pipeline units are each operable to analyze the message; 
15 the Identified pipeline unit is operable to accept the message; and 

the other pipeline circuits are operable to reject the message. 

13, The computing machine of claim 1 1 , further comprising: 

wherein the communteatlon bus comprises a plurality of branches, a 
respective branch coupled to each pipeline unit; 
20 wherein the processor is operable to generate a message that identifies one 

of the pipeline units and to drive the message onto the pipeline bus; and 

a router coupled to each of the branches and to the pipeline-bus Interface and 
operable to receive the message from the pipeline'-bus interface and to provide the 
message to the identified pipeline unit. 

25 14, The computing machine of ciaim 1 1 , further comprising: 

wherein the communication bus comprises a pluraiity of branches, a 
respective branch coupled to each pipeline unit; 
a secondary bus; and 

a router coupled to each of the bmnchos, to the pipeline-bus interface, ar^d to 
30 the secondary bus. 

1 5- A method, comprising: 
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sending data to first of a pluraiity of pipeiine units via a communication bus, 
each pipeline unit including a respective hardwired pipefine; and 
processing the data with the first pipeline unit. 

16, The method of claim 15 wherein sending the data comprises: 

5 sending the data to a router; and 

providing the data to the first pipeline unit with the router via a respective first 
branch of the communication bus. 

17, The method of claim 15 wherein sending the data comprises sending 
the data to the first pipeline unit with a processor 

10 18* The method of claim 15 wherein sending the data comprises sending 

the data to the first pipeline with a second of the piurallty of pipeline units, 

19, The method of claim 16, further comprising driving the processed data 
onto the communication bus with the first pipeline unit, 

20, The method of claim 15 wherein processing the data with the first 
15 pipeiine unit comprises: 

receiving the data from the communioation bus with a hardwired-pipeline 

circuit, 

loading the data into a memory with the hardwired-pipeline drcyit» 
retrieving the data from the memory with the hardwired-pipeline circuit, and 
20 processing the retrieved data with the hardwired-pipaiino circuit 

21 , The method of claim 15, further comprising: 

wherein processing the data with the first pipeline unit comprises, 

recaMng the data from the communication bus with a 
hardwired-pipeline circuit, 
25 processing the received data with the hardwired-pipeline circuit, and 

loading the processed data into a memory with the hardwired-pipeline 

circuit; and 

retdeving the processed data from the memory and driving the 
processed data onto the communication bus with the hardwired-plpeiine circuit 

30 22, The method of c!am 1 5, further comprising: 

33 
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generating a message that InGludes the data and that Identifies the first 
plpeiine unit as a reoipient of the message; and 

wfierein sending the data to the first pipeline unit compnses determining from 
the message that the first pipeline is a recipient of the message* 
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